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ORIGINATING SERVER AND CACHING PROXY SERVER(CP) 
NEGOTIATE, THROUGH REAL-TIME STREAMING PROTOCOL 
(RTSP) FOR SERVER TO SEND AND CP SERVER TO RECEIVE 
STREAMING MEDIA DATA (FOR EXAMPLE: QUICKTIME 
STREAMING AUDIO DATA). 



CP SERVER RECEIVES STREAMING MEDIA DATA, USING REAL 

TIME TRANSFER PROTOCOL (RTP), IN STREAMING MEDIA 
FORMAT NOT THE SAME FORMAT AS STORED ON ORIGINATING 
SERVER AND CP SERVER STORES THE STREAMING MEDIA DATA, 
IN THE STREAMING MEDIA FORMAT, ON A STORAGE DEVICE 
CONTROLLED BY CP SERVER. 



CP SERVER RECEIVES REQUEST, THROUGH RTSP, FROM A 
CLIENT FOR THE STREAMING MEDIA DATA AND RETRIEVES THE 
DATA FROM THE STORAGE DEVICE AND TRANSMITS THE 
STREAMING MEDIA DATA TO THE CLIENT SYSTEM. 



FIG. 1A 



Replacement Sheet 
Atty. Docket No. 04860.P2535 
Application No. 09/603, 1 08 



100 



CLIENT 
COMPUTER 
SYSTEM 




CLIENT 
COMPUTER 
SYSTEM 



CLIENT 
COMPUTER 
SYSTEM 



FIG. 1B 



Replacement Sheet 
Atty. Docket No. 04860.P2535 
Application No. 09/603,108 



252 



PROCESSOR 



I 



255 



MEMORY 



I 



BUS 256 



I 



258 



DISPLAY 
CONTROLLER 



I 



I 



262 



MASS 
MEMORY 



DISPLAY 



260 



DIGITAL PROCESSING 
SYSTEM 250 



T 




I/O 

CONTROLLER 



I 



266 



I/O 
DEVICES 



MODEM OR 
NETWORK 
INTERFACE 



268 



FIG. 2 



Replacement Sheet 
Atty. Docket No. 04860.P2535 
Application No. 09/603,108 



301 



RTSP & RTP 



SERVER(S) 




FIG. 3 



301 



SERVER(S) 



CACHING PROXY 
SERVER (CP) 




RTSP & RTP 

FIG. 4 



Replacement Sheet 
Atty. Docket No. 04860P2535 
Application No. 09/603, 108 



CP ASKS SETUP IN RTSP 
FOR AUDIO DATA AND SPECIFIES 
EXTENSIONS TO RTP DATA 
FOR AUDIO DATA 

■ i 

SERVER RESPONDS/NEGOTIATES 

I 



CP ASKS SETUP IN RTSP 
FOR VIDEO DATA AND SPECIFIES 
EXTENSIONS TO RTP DATA 



SERVER RESPONDS/NEGOTIATES 



I 

CP ASKS PLAY IN RTSP 



I 

SERVER RESPONDS WITH RTP DATA 
FOR ALL TRACKS WITH NEGOTIATED 
EXTENSIONS 
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CP ASKS FOR TRANSMIT TIME 
INFORMATION FROM THE SERVER 



SERVER RECEIVES THE REQUEST FOR 
TRANSMIT TIME (TT) 



701 



702 



SERVER RESPONDS AND SENDS TT 
IDENTIFIER CODE, WHICH 
CORRESPONDS, TO TT TYPE OF 
EXTENSION, IN AN EXTENSIBLE 
HEADER FORMAT - STREAMING DATA 
IS SENT WITH TT EXTENDED DATA 



-EXTENSIBLE HEADER FORMAT IS A 
SUB-EXTENSION CONTAINING A SUB- 
EXTENSION ID, IDENTIFYING THE 
CONTENT OF THE INFORMATION. 
-TT SUB-EXTENSION ALSO 
CONTAINS A SINGLE 64-BIT 
UNSIGNED INTEGER REPRESENTING 
RECOMMENDED TRANSMISSION 
TIME OF RTP PACKET IN 
MILLISECONDS 

I 



CP GETS THE TT DATA, REMOVES 
EXTENSION HEADER AND STORES THE 
DATA LOCALLY; TT TIMES ARE 
ASSOCIATED WITH APPROPRIATE 
STREAMING DATA 



CLIENT REQUESTS STREAMING DATA 

BY MAKING A PLAY REQUEST IN 
RTSP 



703 



SERVER DOES NOT RESPOND TO 
REQUEST. THIS INDICATES THAT 
SERVER DOES NOT SUPPORT THE 
EXTENSION REQUESTED 



709 



704 



CP MAY TERMINATE PROCESS 
IF TT IS CRITICAL ELEMENT 
OF THE CP OPERATION 



710 



705 



706 



i CLIENT MAY ALSO 
' ASK FOR PLAY OR 
_J OTHER DATA DIRECTLY 
711 i FROM SERVER 



CP RESPONDS AND SENDS TRACKS OF DATA AT APPROPRIATE TIMES 
SPECIFIED BY TT TIMES ASSOCIATED WITH STREAMING DATA 
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CLIENT PLAYS DATA 
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CP ASKS FOR FRAME TYPE 
INFORMATION FROM THE SERVER 
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SERVER RECEIVES THE REQUEST FOR 
FRAME TYPE (FT) 
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SERVER RESPONDS AND SENDS FT 
IDENTIFIER CODE, WHICH 
CORRESPONDS, TO FT TYPE OF 
EXTENSION, IN AN EXTENSIBLE 
HEADER FORMAT - STREAMING DATA 
IS SENT WITH FT EXTENDED DATA 
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SERVER DOES NOT RESPOND TO 
REQUEST THIS INDICATES THAT 
SERVER DOES NOT SUPPORT THE 
EXTENSION REQUESTED 



-EXTENSIBLE HEADER FORMAT IS A 
SUB-EXTENSION CONTAINING A SUB- 
EXTENSION ID, IDENTIFYING THE 
CONTENT OF THE INFORMATION. 
FT SUB-EXTENSION ALSO 
CONTAINS 64-BIT UNSIGNED INTEGER 

VALUE WITH WELL-KNOWN FRAME 
TYPES SUCH AS 0-UNKNOWN FRAME, 
1-KEY FRAME, 2-B FRAME, AND 
3-P FRAME. FUTURE VERSIONS 
CAN ADD MORE FRAMES. 
I 
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CP MAY TERMINATE PROCESS 
IF FT IS CRITICAL ELEMENT 
OF THE CP OPERATION 
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CP GETS THE FT DATA, REMOVES 
EXTENSION HEADER AND STORES THE 
DATA LOCALLY; FT FRAMES ARE 
ASSOCIATED WITH APPROPRIATE 
STREAMING DATA 



T 



805 



CLIENT INFORMS 
CP THAT IT IS 
OVERLOADED 

WITH 
INFORMATION 



CP REVIEWS CLIENT REQUEST STOPS 
SENDING LEAST IMPORTANT FRAMES 
AND SENDS ONLY HIGHER 
IMPORTANCE FRAMES 
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CLIENT MAY ALSO 
ASK FOR FT OR 
OTHER DATA DIRECTLY 
FROM THE SERVER 
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CP ASKS BY NAME FOR ONE OR MORE RTP 
SUB-EXTENSIONS USING RTSP PROTOCOL 



901 



SERVER RESPONDS BACK TO CP INDICATING ITS 
SUPPORT FOR THE REQUESTED SUB-EXTENSIONS. 
SERVER ALSO TRANSMITS TO CP AN IDENTIFIER (E.G., 
NUMBER CODE) CORRESPONDING TO EACH NAME 
OF RTP EXTENSION. CP MAY LATER USE THE CODE 
WHEN RECEIVING EXTENDED DATA. RESPONSE 
MAY OR MAY NOT BE A COMPLETE RESPONSE. 
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CP RECEIVES SERVER'S RESPONSE 



905 



CP DETERMINES WHETHER SERVER RESPONDED 
TO ALL REQUESTED SUB-EXTENSIONS 
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YES 

SERVER RESPONDED TO ALL 
REQUESTED SUB-EXTENSIONS 
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CP REQUESTS SERVER TO SEND ALL 
SUPPORTED STREAMING MEDIA DATA 
ASSOCIATED THE RTP SUB-EXTENSIONS 
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NO 

SERVER DID NOT RESPOND TO ALL 
REQUESTED SUB-EXTENSIONS 
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SERVER SENDS ALL SUPPORTED RTP SUB 
EXTENSIONS AND STREAMING MEDIA DATA 
ASSOCIATED WITH THE RTP SUB- 
EXTENSIONS 



T 



ARE ANY OF THE MISSING SUB- 
EXTENSIONS CRITICAL TO CP 
PROCESSES? 



T 



NO 
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CP STORES SUB-EXTENSION DATA AND 
STREAMING MEDIA ASSOCIATED WITH THE 
RTP SUB-EXTENSION LOCALLY 
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CP MAY REMOVE SUB-EXTENSION FIELDS 
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CP DECIDES WHETHER 
TO TERMINATE OPERATIONS 



CP DECIDES TO PROCEED 
AND REQUEST THE 

REMAINING/SUPPORTED 
SUB-EXTENSIONS 
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CP 

TERMINATES 
OPERATIONS 
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CP EVALUATES CLIENT REQUESTS AND 
PERFORMS FUNCTIONS ACCORDINGLY. 
FOR EXAMPLE FRAME THINNING OR USING 
TRANSMIT TIME OPTIONALLY TO TRANSMIT 
DATA 
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CP SENDS STREAMING MEDIA DATA TO CLIENT 
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